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Abstract 

We consider a new class of interacting particle systems with a countable number 
of interacting components. The system represents the time evolution of the mem¬ 
brane potentials of an infinite set of interacting neurons. We prove the existence and 
uniqueness of the process, using a perfect simulation procedure. We show that this 
algorithm is successful, that is, we show that the number of steps of the algorithm is 
almost surely finite. We also construct a perfect simulation procedure for the coupling 
of a process with a finite number of neurons and the process with a infinite number 
of neurons. As a consequence, we obtain an upper bound for the error that we make 
when sampling from a finite set of neurons instead of the infinite set of neurons. 


1 Introduction 

The activity of a neuron is manifested by the emission of action potentials (spikes). Such 
activity is performed by each neuron in a system composed of a large number of inter¬ 
acting neurons. An estimate of the number of neurons in the human brain is about 80 
billion. Moreover, it is estimated that a single neuron can make about 10 thousand distinct 
connections with other neurons in the system. While the shape of the action potential 
is essentially constant for a given neuron in such a way that each neuron can be distin¬ 
guished by the shape of its action potential, the spike train generated by a neuron depends 
on its intrinsic characteristics as well as on stimuli from other neurons and external to the 
system. 

The action potential occurs with a probability that is an increasing function of the con¬ 
centration of sodium ions inside the cell, which enter the cell via voltage-gated sodium 
channels that are transiently open when the cell is excited. At the end of this process potas¬ 
sium channels are activated and produce an outward potassium current that restores the 
membrane potential to resting level. Once an action potential is generated, it propagates 
through the axon of the neuron and when it reaches the axon terminal neurotransmitters 
are released into the space between the neuron and a nearby neuron (synaptic cleft). These 
neurotransmitters diffuse through the synaptic cleft and some of them bind to synaptic 
receptors in the membrane of the other neuron and change its membrane potential, either 
exciting or inhibiting the neuron, for more details see m- 
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This is the motivation for the introduction of a new class of interacting particle systems 
with infinite range that we consider in this paper. To deal with the problem of the large 
number of neurons seems natural to consider a system with a countable set of components 
with interactions of infinite range. The system describes the evolution of the membrane 
potentials of neurons in continuous time. 

This class of systems is based on the class of models introduced by Galves and Locherbach 
[8]. They consider a system in which the probability of a spike of a given neuron depends 
on the accumulated activity of the system after its last spike. The temporal evolution of 
the system occurs in discrete time. For each neuron at each time the symbol 1 is assigned 
if there is a spike at that time or 0 otherwise. If one looks at a single neuron, the temporal 
evolution seems like a stochastic chain with memory of variable length where the neuron 
needs to look to the past until it finds its last spike. 

In [2]|, Cessac suggested the same kind of dependence from the past in the framework of 
leaky integrate and fire models. He considered a system with a finite number of membrane 
potential processes in discrete time. The image of this process which can be described as 
a spike train is also a stochastic chain of infinite order where each neuron has to look back 
into the past until its last spike time. The process described by Cessac is a finite version 
of the model considered in [8j. 

In our model, we do not need to look back into the past in order to determine the prob¬ 
ability of a spike, the information about the accumulated activity is in the membrane 
potential of the neurons. We consider an interacting particle system with a countable 
number of components having natural state space and interactions of infinite range. 

This paper is organized as follows. In Section 0 we present the model and the two main 
results. The first theorem proves the existence and uniqueness of the model. In the second 
theorem, we give an upper bound to the probability of sampling different outputs of a per¬ 
fect simulation algorithm based on a coupled construction between a process considering 
a finite set of neurons and a process considering the whole system of neurons. Our main 
technical tool is a perfect simulation procedure for the processes. Perfect simulation is the 
name given to any algorithm that generates as output a sample of stationary processes 
whose distribution is ensured that follows a given law of probability. It can be shown that 
when such a sample can be produced the process exists and is unique by construction. 

The perfect simulation scheme that we used is the clan of ancestors , introduced in [4]. 
The algorithm is based on a two-step procedure: (i) in the first step we define a scheme of 
perfect simulation to generate the set of ancestors, which are the predecessors that may 
have an influence on the target process, and (ii) in the second step, using the information 
of the first step, the sample is generated according to the interaction rules of the target 
process. The second step, and hence the whole procedure, is feasible if these ancestors 
form a finite set with probability one. 

Based in the clan of ancestor scheme, in [5] they address the problem of perfect simulation 
for the Gibbs measure with infinite range interactions. In [7J, they consider a particle 
system in Z d with real state space and interactions of infinite range. Assuming that rates 
of change are continuous, they obtained a Kalikow decomposition of the rates with infinite 
range. Thus, rates are represented by a mixing of finite range rate. As an application of the 
decomposition they introduced a perfect simulation algorithm for the system. The same 
technique is used in [8], where they introduced a Kalikow decomposition for the transitions 
probabilities with infinite order. In our case, we do not need to use the technique of Kalikow 
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decomposition, since the rates of the system does not depend on the global configuration 
of the system. The technique used here is inspired by the construction of a system of 
interacting Markov processes presented in [TJ. 

In Section 13.11 we introduce the backward sketch process which is the basis of the perfect 
simulation algorithm. Section lT2l presents the coupled perfect simulation algorithm for the 
couple processes and presents the results ensures that the algorithm is successful. Sections 
[4] and [5] are devoted to the proof of the mains results of the paper. 


2 Definition and results 


We consider an interacting particle systems on X, a countable set of neurons, having state 
space given by {0,1,... } and interactions of infinite range. The elements of the state 
space are called potential. To each neuron in X we assign a potential. The potential of the 
neurons changes as times goes by. 

We denote by S' = {0,1,... } x the configuration space with its product sigma algebra 
SS. We call an element of S a configuration. Configurations will be denoted by Greek 
letters £, r/, £,.... For each neuron i £ X at time t £ M, £t(i) £ N represent the membrane 
potential of i at time t. Let i € I, k > 1} be a family of subsets of X, where V^. is 

the set of neurons that are affected by the spike of neuron i, when the membrane potential 
of i immediately before the spike is greater or equal to k. Note that the sets V^. doesn’t 
need to be finite. 


To define the dynamics of the process (£t)te R, we need to introduce the family of trans¬ 
formations { 7 £ X, k > 0} such that 7 : S S defined as follows, for i £ X and 


k > 1, 


*?(«(«) 


£(«) 

d u ) 

£(«) +1 
0 


if £(i) < k, 

if u ^ i,u V-1+. and £(i) > k, 
if u / i, u £ V^. and £(i) > k, 
if u = i and £(*) > k. 


For A: = 0 




£(u) if u 7 ^ i, 

£(u) + 1 if u = i. 


In other words, given a configuration £ the transformation irk only changes the configu¬ 
ration of the system if the membrane potential of i is equal or greater than the value k 
of the transformation, that is, if £(i) > k. If £(i) < k, we say that the neuron i does not 
have sufficient membrane potential to produce a spike. 

In the case where an spike occurs in i, the neuron loses all its membrane potential returning 
to a resting state, that is represented by 0. Simultaneously, the membrane potentials of 
the neurons within the set V^. are changed by the addition of one unit in membrane 
potential of each neuron. The external stimulus is represented by the transformations nf 
for i £ X. The external stimulus does not causes an immediate spikes in the neurons but 
increases the chances of a spike increasing the membrane potential of the neuron. 

Now we are ready to introduce the dynamics of our process. We consider markovian 
particle systems on S whose generator C is defined as follows, for any boundary cylinder 
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function / : S —>• K 


mo = EE A <«[/T«)) - /«)]. (i) 

iEX fc>0 

where Aj : N —» M+, for i 6l. 

For each i £ Z, define 

Aj = Aj(0) + ^ Aj(/c) + ^ ^ Aj(/c), (2) 

fc>i k > 1 jev^ i 

where = {j £ Z : i £ V^..}, and 

„ _ Ai(0) 

Pi X'' \ (U\ ' (^) 

Ylk >0 Ai(fc) 

The existence and uniqueness of this class is granted in our first theorem. 

Theorem 1 Assume that 

1. 


sup Aj = /3 < +oo, (4) 

i£l 


2. For all i £Z 


S> (k)( Pi f-Y, E A #)>o- (5) 

k>l ^jev^ 

Then there exists a unique stationary process (£*) taking values on S, with trajectory 
continuous on the right, limit on the left and generator C given by w- 

The proof of the Theorem |T] is given in Section [U It is based on the construction of a 
perfect simulation procedure for the process and showing that the number of steps of the 
algorithm is finite almost surely. 

The condition Q is rather restrictive. As an illustration of Theorem[l]we give the following 
example of a system with satisfies the assumptions of the theorem. 

Example 1 Take Z = {1,2, ... } and assume that |V^J < Ck, for all i £ Z and k > 1, 
where Ck £ N depends only on k. Let s : N — > M+ be a function such that 

s(k) < Too. 

fc >0 

Let {ai)i£x be a non-decreasing sequence of real number with at > 0 for i £ Z. Assume 
that the sequence (af) satisfies the following property 

sup{aj : i £ Zj < Too, 
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where a, = sup{aj : j € Ufc>iV/N}. For each i £ Z define 

Xi(k) = ais(k ) /or k > 0. 


For a fixed i £ Z, 

A j < a* c k s{k). 

k >0 fc>l 

Thus, the condition |/Jj is satisfied if Ylk>i c k s (k) < oo. Note that pi = s(0)/ Yf k >o s ( k ) 
for all i £ T and Y^ k >i s {k)p k < s i k ) c k- Then, if we have the following inequality 

hi < a^, where r € (0,1), 

f/ie condition (ED is satisfied. 


Now let us consider the process (/j^) on i/A = {0,1,... } F , where F is a hnite subset of 
F. A natural constraint on a hnite set F C I of the transformations 7rl is given by, for 
ieF and k>l, 


^’ [F] (Z [F] )(u) = 


e F \u) 

Z [F] (u) 
f [F] {u) + l 
0 


where V^fiF) = Vjf+. n F. 

For k = 0 

^°’ [i V ] )(u) = 


if /^(i) < k, 

if u / i,u V k _^.{F) and /^(i) > k, 
if u ^ i,u € V-f+fF) and /^(i) > k, 
if u = i and /^(i) > k, 


if 

£^(u) + 1 if u = i. 


Then the generator £\ F ^ of the process (/j^) is given by 

c [F] fti [F] ) = E E x i( k )if^i ,lF] (t [F] )) - f(t [F] )]- 


iG-F k >0 


( 6 ) 


The next theorem guarantees the existence of a perfect simulation algorithms based on a 

fFl 

coupled construction of the two processes, (£t) and (/) ). Moreover, provides an upper 
bound for the error we make when sampling from a hnite set of neurons instead of consider 
the whole system. 


Theorem 2 Under the assumptions of Theorem [1J For any F finite subset of Z and 
i £ F, there exist a coupled perfect sampling algorithm for the pair (£(i),£^(i)) satisfying 

r(f«#{ [F1 «)< P) 

1 — a 

where 

<5(F) = sup 1 EE E A J‘( A: ) 1 b' G F- ( 8 ) 

cci:\c\<oo l^u'ec u ' ueCk>\j^vF ru 

Note that (5(F) —> 0 when F —>• Z. The proof of the inequality fl7|) will be given in Section 

0 

The two theorems show that the process considering an infinite number of neurons is a 
good reference to phenomena that appear when the number of neurons is very large. 
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3 Perfect simulation 


Our goal is to construct a perfect simulation algorithm that generates as an output the 
value of the membrane potential of any fixed neuron i G 1 The simulation procedure 
has two stages. In the first stage we determine the set of neurons whose activity influence 
the membrane potential of neuron i under equilibrium. This stage will be called backward 
sketch procedure. For this, we climbing down from time 0 back to the past of neuron i 
until the last time that a Poisson clock rang, with rate A*. At this time, we choose a pair 
(j. k), where j £ X and k > 0, with a certain probability. If j = i and k ^ 0, we assign the 
value 0 to the value of the membrane potential of neuron i. If j ^ i and k ^ 0, we restart 
the above procedure for the two neurons i and j. Finally, if j = i and k = 0 we restart 
the procedure just with neuron i. The procedure stops whenever for all neuron j involved 
in this backward time evolution one choice of the pair (j, k ^ 0) occurs. 

When this occurs, we start the second stage, called forward spin assignment procedure , in 
this stage we go back to the future assigning the value of the membrane potential to all 
neurons visited during the first stage. We know that the value of the membrane potential 
of all neurons in the end of the first stage is 0 at the time which k ^ 0 is chosen. Using 
this information we can determine the value of the membrane potential for all neurons 
visited in the first stage at each time that the Poisson clock rang up to time 0. 

3.1 Backward sketch procedure 

Before describing formally the two algorithms described above, let us define the stochastic 
process which is behind the backward sketch procedure. Our goal is to define, for each 
neuron i £ X, a process (Cs^) s >o taking values in the set of finite subsets of 1, such that 
Cs is the set of neurons at time — s whose activity may affect the membrane potential of 
neuron i at time t = 0. 

Let £ = : i,j £ I, k > 0} be a family of transformations in V{1), the set of all 

finites subsets of 1, defined as follows. For any unitary set {u}, for j ^ i and k > 1 



(M) 


{i, j}, if u = i and j £ V ^ 
{u}, otherwise. 


For j = i and k > 1, 



(M) 


0 , if u = i 
{-u}, otherwise. 


For j £ I and k = 0 

({«}) = {u}, for all u. 


For any C Cl finite, we define similarly 

# t, (c) = u A*({«}). 

ueC 


(9) 


( 10 ) 


( 11 ) 


(12) 
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Let v : S —> M + be a function define as follows, for i G X, 


z/ 


:# S) ) 


' Aj(fc), _ if j 7 ^ i and j £ 

A i(k)(pi) k , if j = i and fc > 1 

Aj(0) + J2i> 1 M0(1 - (Pi)0> if j = i and k = 0 

, 0 , otherwise. 


(13) 


Let {N a ,a £ E} be a family of independent Poisson point processes with rate v(u) 
respectively. Let us introduce the Poisson point process N on M + x E as follows 

N(B x I) = ^2N a (B), 

crG/ 


where B £ 13(0, +oo) and JcE finite. For each i £ X, we can define 


f inf{t > 0 : N(]0,t\ x E») > 0}, if EaeS; "( a ) > °> 
l +oo, if EaeSi 


(14) 


where E* = {erp’^ : k > 0, j £ V’F U {z}}. 

By hypothesis (jl]) we have that X)o-es z/ ( cr ) = Aj < oo. Thus, if we exclude the second 

(i) . 

case, T( J is a exponential random variable with parameter Aj. Moreover, we know that 
at time t[ 1 ' 1 a transformation II ^ £ Sj, independent of T^\ occurs with probability given 

by 


Define 


p( n® = a) = 


^. if^eEi, 

0 , otherwise. 


cf = n^({*}). 


( 0 / 


(15) 


Let T be a stop time of the process N and I a random subset of E, Ft— measurable, such 
that YlcTei l '( a ) > 0- Define the random variable S(T,I) by 


S(T,I) 


inf{f > T : N(]T, t] x I) > 0}, if T < oo and Yla&l v ( a ) > 0, 
oo, otherwise. 


If S(T,I ) is finite, we know that S(T,I ) — T is an exponential random variable with 
parameter Ylaei z'(ct) and at time S(T,I) the transformation II(T, I) £ I occurs with 
distribution given by 


P(U(T,I) = a) = 
Now we can define recursively 

->(*) 


0, 


if a £ I, 
otherwise. 


= S(r n ,E- (0 ), 


c. 


(*) 

n+1 


= n(r«,% 


o)(C« 
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where = U ue(9 « 

The sequence of successive jumps times and the Markov chain (cJJ define the 

backward sketch process starting from {z} at time s = 0, denoted by (ci^) s >o. The 
infinitesimal generator Q of the process is given by 

g/(c) = ^^)[/m)-/(c)], (i6) 

crES 

where / : V(l) —>• M is any bounded cylinder function. 

Proposition 1 1 . Suppose that 

i/(<r) < oo for all i £ Z. (17) 

T/ien f/iere exist a probability space (fi, B , P) on which we can construct, for all 
i £ Z, a version of the Markov jump process (Cg ) 3 >o with initial condition at time 
s = 0, Cq ] = {?'}, and infinitesimal generator define in m>- 

2. Suppose moreover that 

sup K^)(HW)I - 1) = c < oo. (18) 

ieI o-es 

Then, for all i £ 1, the process (cJJ does not explode (i.e., |c|^| < e cs for any 
s > 0). 


Proof The first part of the proposition is proved by the above construction. We just 
need to prove that the process does not explode. For all n £ N and i £ Z, we have the 
following equality 


E(|C 1 AT<‘>l ) = 1 + 5Z , '(‘ r ) IE 

a 

By the hypothesis (fTKlh we have 

^^)(k(^)|-|c«|)<c|c» 

a 


rtAT^ 

/ dW(k(cf>)l - icfn 

Jo 


(19) 


( 20 ) 


From (fT9l) and (l20l) . we have that 




f \C® (0 |ds 

Jo sAT ^ 


By the inequality of Gronwall, we have 


E(|C (i) (i) |) < e ct for all n£ N. 

tAT n 


(21) 






Note that the above inequality holds for all n £ N. Thus, taking the limit of equation 
(ED), we have 

E(|C t W |) < e ct for t £ R+. 


In the same way, we can define the process (cd’^)s>o, for any F finite subset of Z and 
i £l, define by the infinitesimal generator given by 

g [F] f(c)= J 2 ^)[/KC'))-/(c')], (22) 

aeE(F) 

where / : V{F) —> M is any bounded cylinder function and X(F) = £ X : 

i £ F,j £ F,k > 0}. The transformations o^' k ' F ' 1 : V(F) —> V{F) are equal to the 
transformations a^ ,k ) restricted to the set F. 

For the perfect simulation of the coupled process, we need to construct a coupling proce¬ 
dure for the processes (cd) and (cd’^) such that 

Cf ),[F] C Cf\ for all s £ M+. (23) 

The next result guarantees the existence of such coupling. 


Proposition 2 For any F C Z finite and i £ F, exist a coupling between the process 
(d* } ) and (C'd’^) such that the equation is satisfied. 

Proof Let (Tn ^) n >o the sequence of successive jumps times define above. For F finite 
subset of Z and i £ F, we will build a coupling between the process (cd) and (cd’^) 
as follow: 


1. For t £ [0,T-P[, define C t w = C t [t/ ’ ln = {*}. 

2. For n > 1: 

(a) Given , we choose a transformation II ra with probability distribution given 


"<(*) _ /nf(*),[F] _ J O 


by 


G°-) 


P(n n = a) = { if(T€S -’ 

I 0, otherwise, 


where S n = {a^’ k) : u £ ,k>0,j£ V h fi u U {u}}. 


(*) 


(b) Define for T$ < t < T^ +l 


1 = 


where £ n (F) = {a£ k) : u £ > 0, j £ V^ U {F) U {u}}. 


n n (d^ [F1 ), if n n e E n (F), 

1 n-1 


C 


( 0 , 1*1 
n— 1 

( 0 . 1*1 


otherwise, 


Thus, by the above construction, the inequality (l23l) holds. 
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3.2 Algorithms 


Now we can introduce the algorithm that generates as an output the value of the pair 
(£(i), °f the coupled process, for any F Cl finite and i G F at time t = 0. The 

following variables will be used. 


• N is an auxiliary variable taking values in the set of non-negative integers {0,1,2,...}. 

• Ng^op and Ng^op are counters taking values in the set of non-negative integers 
{0,1,2,...}. 

• B and B^ are arrays of elements of X x {0,1, 2,... }. 

• C and are variables taking values in the set of finite subsets of X. 

• For k > 1, V(k) is a variable taking values in the set of finite subsets of X. 

• V is a variable taking values in the set of finite subsets of X. 

• p is a vector of elements of {0,1,2,...}. 

• &(*) is a variable taking values in the set of non-negative integers {0,1,2,...}. 


We will present the backward sketch procedure for the coupled perfect simulation algo¬ 
rithm. The backward sketch procedure for the process (£*) can be immediately deduce 
ignoring the steps 20 to 30. 

Algorithm 1 Backward sketch procedure 


1 . 

2 . 

3. 

4. 

5. 

6 . 


Input: F C X, i € F, j VK^pj G X, k > 1 j 

Output: N f TOP , ^STOP' B and B[F] 

N <- 0, <- 0, C <- {i} and <- {i} 

While C / 0 do 

N <- N + 1 


For each /c > 1, define F(A;) U u eC u {u} 

Choose J and K randomly in X X {0,1,... } according to the probability distri¬ 
bution 


P(J = j,K = k ) 


A j(k)l{j G V(k)} 
SueC -A-u 


7. If J G C and A" / 0 then 

8. M <- 0 

9. While M < K do 
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10 . 


Choose an integer K' randomly in {0,1,... } according to the probability 


distribution 


P(K' = k) 


Aj(fc) 

12i>o Aj(0 


11. If It'' = 0 then M M + 1 

12. Else, M <- K + 1 

13. End If 

14. End While 

15. If M = K then C <- C/{J } 

16. End If 

17. Else C<- CU {J} 

18. End If 

19. B(N)^(J,K) 

20. If / 0 

21. If J £ F then 

22. <- A7^] + 1 

23. ^[C(at[C) «_ 

24. If J € C [i?1 then 

25. If M = K then <- /{J} 

26. End If 

27. End If 

28. Else <- U { J} 

29. End If 

30. End If 


31. End While 

32. A^top N and n stop W [F] 

33. Return: N^TOP' ^STOP • B and 

In the end of the first stage, the algorithm returns ^stop^STo'p) the num ber of steps 
we need to go back in the past to determine the value of ^(z)(^ F l(i)). As well as R(Rt F 1) 
the set of ancestors of neuron i. 

If B = B^ f 1, we know that all the neurons that were visited in the first stage belongs to 
the set F. Then we use one time the forward spin assignment procedure to determine 
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£(*) = If B / B^ f \ then we use the procedure twice independently, with input B, 

Nstop to determine £(i) and B^ F \ Ng^p to determine 

The second stage uses the output of the first stage to determine the values of £(i) and 
and the procedure is given by the following algorithm. 

Algorithm 2 Forward spin assignment procedure 

1. Input: i G 1, Nstop > {f/L*.., j G 1, k > 1 j 

Output: {£(*)} 

2. N g- Ng^ 0p , V •(— 0,p 0, •(— 0 

3. For n G- A to 1 do 

4. J<-B[n,l] 

5. A^R[n,2] 

6. If J qL V then 

7. 

8. p[J] g- 0 

9. Else 

10. If K = 0 then p[J] g- p[J] + 1 

11. End If 

12. If k < p[J] then 

13. p[J] G- 0 

14. For m € V F _^. do 

15. If m G V / { J} then p[m] G- p[m\ + 1 

16. End If 

17. End For 

18. End If 

19. End If 

20. End For 

21. Return £(i) G- p[i\ 
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Let 


4 top = inf {s > 0 : C'.F = 0} 

(z) . (i) 

be the time in which the process C s ; reaches the empty set. Note that if Tgf OP < oo, 
then C's*- 1 = 0 for all s > T pp0 p- 
We also can define 

A stop = i R f{ n > 0 : A? = 0} (24) 

the number of steps that we have to go back to determine the set of ancestors. The 
definition in (|24|) is equivalent of the Ng POp defined in the Algorithm 1. 

(i) 

For the algorithm to be successful, we need to show that the number of steps N y SPOp is 
finite. This is the content of the next theorem. 

Theorem 3 Under the codition 

y- z'(o-)KW)! 

iei A t 

we have for any i S X, 

stop > re ) A a n 

and 

^(A^stop) - i_ a - 

The proof of the Theorem [3] will be given at Section 01 Note that the condition ((5|) implies 
the condition (051) . Let us start by proving Theorem [3j 


(25) 

(26) 

(27) 


4 Proof Theorem |T| and [3] 

This section is devoted to the proof of Theorem |T] and Theorem [31 To proof the Theorem 
[T]we use the results given by the Theorem [3l 


4.1 Proof Theorem [3] 


Let us start by proving the first inequality ([26l) . Let Z n = \C n \ be the cardinality of the 
set Cn after n steps of the Algorithm 1. 

For i £ I, we have 


^{ 4 op >«} < p{&\>l} 

= E(z n ) 


(28) 
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~ (j\ 

Given C™ , the expected value of Z n+ \ is given by 


u(a) 


= E E „ (<T , 

=v(0 cr£S u eS « v 


77 K*) 


u£C n 


By the condition 


^{z n +l) < cdE(^n) 


< a 


n+1 


(29) 


Then by (1281) and (1291) , we conclude the proof of the first part 


P {-Estop > n | < a . 


For the second inequality, let {YjE; n £ N, i € T} a family of independent random variables 
taking values in {—1,0,1}, independent of the process ( Cn E such that 


p(y n w = -i) = 
p(y« = o) = 
p(y® = i) = 

By condition 1251 we have 


Efc>i *i(k)(pi) k 

A * 

E(°) + Efc>i E(E( 1 - ( Pi ) k ) 
E 

Efe>i Ejev;^. E'(E 

E ' 


supE(y n W) = a — 1 < 0. 
iex 


(30) 


(z) . 

For any i E I, let us call JA the index of the neuron whose Possion clock rings at the 
n—th jump of the process (C.E)- Recall that J,E are conditionally independet given the 
sequence (cE)n such that 


^(4° = ilC'fi) = , ifi e 44- 


E«ec«, 


Let (5’E )n>o be a process taking values in Z, with initial condition S’E = 0, such that 


(0 


4° = fo^>i 


m=l 


Note that by construction, M n = ,S’E + (1 — a)n is a super-martingale. Then a very rough 
upper bound is 

-ZjE < 1 + 'S’E as lon g as n < Vstop, 
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where V$top = min{n > 1 : S n = —1}. Then , by construction 


/yW < yW 

iv STOP — v STOP- 


By the stopping rule for super-martingales, we have that 


E(s ( i) 

^STOP^N 


) + (1 — a)K(Vg^ OP A N) < 0. 


But notice that 




‘P^STOP — ^0 + iVsTOP ^ ^0- 


On {T^x)p ^ — 0’ hence we have that E(S’]'*( i 

conclude that 

1 


?(0 


?(0 


(0 .J>-^i?op<^)- We 


E(F« 0p AiV)< 


P(V£ 0 P < ^)- 


1 — a 


Now, letting N —>• oo, we get 


®(^5TOp)— 


and therefore E(iYg, p0 p) < 


1 — a 


1 — a 


4.2 Proof of Theorem H] 

It can be shown that if we can construct a perfect simulation algorithm and such algorithm 
is successful, then the process exist and is unique by construction. The algorithm is 
successful if the number of steps Ng POP is finite almost surely. 

The construction of the algorithm was given in Section [3j Here we are going to proof that 

u\ 

the number of steps N SPO p fi R ite almost surely. 

By Theorem [3l we have that 

P(-^stop > n ) — aTl > 
where a £ (0,1). This implie that 

°° ^ 
y ! p(^stop > n ) ~ i _ a < °° 

77 .— 0 

Thus, by Borel Cantelli, we have that 

P(^stop > n) = 0 , 

for all n sufficiently large. Therefore, the Algorithm 1 is successful and the exist a unique 
stationary process (£$) taking values in S with generator given by JT]). 
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5 Proof of Theorem [2] 


We have to show that the coupled perfect sampling Algorithm 1 achieves the bound (|7|) . 
Let Tp be the first time that a neuron j that does not belong to the set F is chosen in 
the draws that define the set of ancestors, given by 

Tjp = inf{t > 0 : cf ] U P ^ 0}. (31) 

Recall that in order to construct f and we use the same Poisson point processes for 
all j € F. Thus we have that 

— 1STOP )• (32) 

By Lemma given below we conclude the proof of Theorem [3j 
Lemma 1 For any F finite subset of X and i £ F, we have that 

P{T$ < T&op) < (33) 


Proof For F and C finite subsets of X define the event 

A n {F, C) = {n(pW, Sc) = a, for some a € E C (P)} , 


where £c(P) = {au' k> : u € C, k > l,j € fl X} and II is a random variable taking 
values in S define in Section El Thus, 


f rp(i) rp(i) \ 

l-Lp — 1 STOPS 


U U M»WC'® 1 ),C< i l 1 =C,W« op >n-l} 

n> 1 CeV(F) 


and 


P ( T W 


< T, 


(0 


STOP) 


< E E P{A n {F^ ) )\C^_ 1 = c , N f TOP >n-l) 

n>lC£V(l) 

xP(C« 1 = C,!V« OP >n- 1) 
= ^E(P(A n (X,SC« 1 )|(7« 1 = C,Nf TOp > n- 1)). 

n> 1 


Given we have that 

p(n(r«,sc'« 1 ) = a^ fc )) 


A j(k)l{j E P} 
x A -' ’ 


for u € C^l_ j, k > 1 and j € V / f, u . Hence, 

P(A n (F,SC^l 1 )lC^l 1 = C,Ngp 0p > n- 1) = q(F, C)l{N^ TOp > n - 1}, 
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where 


1 


q(F,C) = 


Su'eC ^ 


EE E \j{k)l{j € F} 


u'eC ue c k>lj£V: 


Note that, fo any C finite subset of X, we have that q(F,C) € [0,1]. Define, for F finite 
subset of X, 


Thus 


5(F) = sup {q(F, C) : C finite subset of X}. 


P(T«<T« op ) < 


^E(<5(F)l{iV« 0p >n-l}) 

ri> 1 

= ,5(F)^P(iV« 0p >n-l) 

n>l 

= 5(E)E(< OP ) 


(34) 


Concluding the proof, since ¥,(Ngj, OP ) = jf— by Theorem [3j 
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